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ASSTAACT 

\„ 

-^A  eie^le  dess  of  discrete-- tlae  noolineer  sto¬ 
chastic  control  problems  with  quadratic  costs  for 
linear  aysteas  with  randoedy-jumping  state-dependent 
paraaeters  are  solved  using  dynamic  proqraaaing .  The 
resultiiig  controllers  exhibit  *  active  hedging* 
properties. 

1.  Xntroduc^on 

Complex  engineering  systeae  occasionally  fail  to 
functiem  as  dssired,  rsgsrdlass  of  how  vsll  they  are 
designed  end  aanufectured.  This  can  result  in  cat- 
astrophically  high  huaan  and  awaetary  coata.  Tradi¬ 
tionally*  engineering  syateae  have  been  aade  reliable 
by  the  use  of  highly  reliable  ooeqx’nenta  and  assembly 
procedures  to  that  failures  are  unlikely*  and  through 
the  use  of  redundancy  in  deelgn  so  that  individual 
failures  need  not  be  catastrophic  to  the  entire  sys¬ 
tem.  A  different  approach  la  to  use  probabilistic 
information  about  componsnt  failurss  as  %#sll  as  ob¬ 
servations  aade  during  system  operation  to  achieve  an 
adaptive*  dynamic  form  of  reliability  in  which  the 
system  enticipetes  feilures  end  avoids  or  adapts  to 
them.  In  this  paper  we  develop  a  design  methodology 
Cor  feedback  controllers  with  this  ^ault- tolerance. 

Fault-prone  systems  gsnerally  experisnes  abrupt 
changss  in  structurs  and  state  from  phenomena  such  as 
coBponent  and  subsystem  failures  and  repairs*  changing 
subsystem  interconnections*  changss  in  state  equilib¬ 
rium  points  and  abrupt  envirofental  distrubances. 

A  characterising  attribute  of  fault-prone  systems  is 
their  operation  in  different  forms*  where  each  form 
corresponds  to  some  combination  of  these  events. 

fis  will  represent  fault-prone  systems  by  dis- 
ersts-time  'hybrid*  continuous-plus-disersts-stste 
modsls.  These  model  can  be  used  to  represent  non¬ 
linear  systems  with  multiple  equilibria.  They  can  be 
represented  as  a  set  of  linearised  models  (of  phase 
or  X  dynamics)*  ^dtere  the  form  des¬ 

ignates  the  appropriate  operating  region  of  the  phase. 
As  long  as  ths  phass  subsystem  state  rsmmins  within 
the  dosuiin  of  attraction  of  Its  current  equilibrium 
point*  the  system  is  in  a  form  associatsd  with  that 
point.  Mhwi  it  Issvss  this  region*  the  form  changes. 
This  kind  of  model  should  be  amenable  to  detailed 
analysis  since  it  consists  of  linsar  'piscss*.  Zt 
has  bsen  proposed  for  the  modelling  of  electric  power 
systems  (110)*  (ID)  beeeuss  it  appears  to  eapturs 
some  important  aspects  of  thsse  systsms. 

For  sxempls*  sn  'initiating  svent*  (ecmponsnt 
failure  or  exogenous  disturbance)  that  causes  a  change 
in  the  phese  dynamics  can  lead  to  large  phase 


transient  responses*  because  the  system  is  not  near 
ths  equilibrium  of  the  new  form.  These  transients 
may  force  soltages  or  evurrSAts  (that  is*  the  phase 
subsystem  state)  to  exceed  allowable  values,  causing 
new  form  changes  as  protective  relays  switch*  com¬ 
ponents  bum-out.  stc.  These  form  changes  are  ac- 
companisd  by  nsw  phass  squilibrium  values  which  tim 
phase  stay  be  far  away  fromi  thus  th«rc  are  extended 
transients  which  may  cause  still  more  form  changes, 
and  so  on.  Such  cascadss  or  'waves*  of  system  fail¬ 
ures  have  been  observed  to  occur  in  Isxge  scale  black¬ 
outs  (see*  for  exasple,  (8)). 

Continuous  tijs*  control  problems  involving  hybrid 
systems  have  been  considered  by  a  number  of  authors. 

A  survey  of  these  results  is  included  In  17). 
Krasovskii  and  X4dskii  |5)  obtained  most  of  the  re¬ 
sults  which  srs  available  for  continuous  time  models. 
These  problems  were  also  studied  by  Honhaa  (12)  fad 
Sworder  (6).  Discrete  time  versions  of  these  prcAlsms 
have  not  been  investigated  as  thoroughly.  Sobm  re¬ 
sults  appear  in  (l)-t3)*  and  in  the  (suboptiaal)  mul¬ 
tiple  model  adaptive  algorithm  described  in  (41*  (9). 

2.  Modelling  of  Fault-Prone  systems 

the  state  of  a  fault-prone  system  esa  be  decom¬ 
posed  into  two  parts<  a  form  process*  p*  which  in¬ 
dicates  ths  opsrational  status  of  ths  system*  end  the 
rest  of  the  state  which  we  call  the  phase  procAs*  x. 
A  logical  structure  for  modelling  this  kind  of  systims 
^***  hybrid  arra.vgem«iit  depicted  in  Figum  1.  ft  is 
a  feedback  connection  of  two  subsystema:  a  phase  sub¬ 
system  that  rspresents  ths  dynamic  evolution  of  the 
state  between  fora  shifts*  and  a  form  subsystem  that 
describes  form  tra.-.sltions. 


Outputs  Kxogeneous 

Form  Inputs 
(Dlsturbences 
and  Controls) 

Figurs  It  General  Hybrid  Systam  Structure. 


This  research  was  supported  by  the  Department  of  Energy  under  Contract  ET-76-C-01-2295 
and  under  contract  supported  in  part  by  the  Office  of  Naval  Research  under  contract 
No.  N00014'77-C-0224.  Also  by  NASA  Ames  Research  Center  under  Grant  NGL-22-009-124. 

i  i)i»Ratm6N''sijgro^ 


Appravsd  for  public  rsiaose: 
DUMbuUon  UnUroited 


2 


phas«  subsystMi  atat*  x  (usually  caking 
values  in  a  finite-'dinensional  vector  space).  It  can 
be  oodelXed  by  detensinistic  or  stochastic  finite* 
diaensional  vector  differential  or  difference  equa* 
tlons.  the  paraoeters  of  these  wodels  will  de^^cnd 
upon  the  for»,  p,  which  feeds  into  the  phase  sub- 
s/ste.-a.  In  this  way  the  dynamic  effects  of  component 
failures  and  other  form  shiLfts  can  be  captured  in  the 
phase  model. 

The  phase  subsystem  can  also  experience  abrupt 
jumps  In  its  state.  These  jumps  might  modal  the  ins¬ 
tantaneous  results  of  fora  shifts;  in  electrical  sys¬ 
tems,  voltage  and  current  jumps  that  accompany  broken 
connections  or  sensor  failures  are  examples  of  this. 
Phase  jumps  need  not  be  associated  with  form  shifts, 
however.  Aircraft  acceleration  changes  caused  by 
flying  into  air  pockets,  transient  sensor  biases,  and 

voltage  j'iaps  in  electrical  systems  caused  by  light¬ 
ning  bolts  are  examples. 

The  form  subsystem  has  a  scalar  stata  p  (usually 
taking  values  in  a  finite  set).  A  crucial  consid¬ 
eration  in  the  modelling  of  stochastic  hybrid  systmne 
is  the  realistic  representation  of  form  transitions. 
We  wish  to  consider  hybrid  systesu  where  the  form  can 
change  in  two  kinds  of  ways; 

independently  of  the  phase  (as  though  no  phase- 
to-form  link  in  Figure  1) 

•  as  a  (possibly  random)  function  of  the  phase 
(that  is,  with  feedback) . 

Examples  of  phase- independent  form  shifts  are 
random  *no  wearout*  component  failures  and  lightning- 
induced  failures  in  electrical  power  distribution 
systems.  Examples  of  phase-dependent  form  shifts  in 
electrical  power  systems  include  restructuring  of  the 
system  when  generator-protecting  relays  and  circuit- 
breakers  trip,  human  operator  control  actions  based 
on  observation  of  the  phase  dynamics  (such  as  switch¬ 
ing  on  auxilary  generators)  and  transmission-line 
failures  due  to  current  overloads.  Note  that  both 
kinds  of  form  shifts  can  be  totally  unpredictabls 
(as  in  random  *m>  wearout*  component  failures), 
totally  predictable  (as  in  schedulsd  direct  control 
actions)  or  partially  predictable  (as  in  the  switch¬ 
ing  of  relays  precisely  (or  approxiMtely)  '^uui  a 
Random  quantity  reaches  a  given  threshold) . 

Hathsaatically,  we  will  describe  s  hybrid  sys¬ 
tem  in  discrete  time,  in  terms  of  a  state  vector, 

(x^,  p|^)  indixed  by  a  time  parameter.  The  form  P^ 

belongs  to  a  finite  set  ^{l,...,mh  the  phase 

belongs  to  and  the  time  horison  is  k-0,1 . . 

Ths  joint  stochastic  procsss  {x^,  p^t  k«o,...,M)  is 

gensrally  assumed  to  be  Markovian  although  neither 
(xj^)  nor  need  be.  We  adopt  the  following  order 

of  operation  convention: 

(1)  at  time  k,  the  system  state  is 

(2)  control  u^  is  determined  from  x^  and  p^^ 

(3)  during  time  Interval  (k,k-^l).  >^4,^  generated 
from  P^  and  control 

(4)  finally,  Is  ganerated  from 

control 

This  convention  allows  a  failure  or  other  form  shift 
to  be  modelled  sa  occurring  at  the  final  time  k>"N. 

The  form  process  (p^)  is  mods lied  byt 

Prob<p(kvl)-l)p(k)«j,  x{ktl)-x)  « 


where  p.  (i,j,x)>  0  arxS  J  p  (i,J,x)-l. 

.X 

The  phase  process  Cx^}  obeys 

&N<m,j,k)  -  N(ci,j,k)  -  N.:a,j,k-1) 
where  is  a  sequence  of  discrete-tic:e  vector  white 

noise  and  the  M(a,j,k)  ere  counters  recordi.-vg  the 
nusabec  of  form  juass  fr:«  m  to  3  th:;ough  tiae  k 
(if  mi* 3)  and  the  nuabei  r;f  chase-only  jumps  while 
in  form  a  (if  o»j). 

3.  4icnf»ral  Problem  Forrrijiation 

A  fault -tolerant  ccr.troller  should  enable  a  sys¬ 
tem  to  operate  acceptably  well  in  many  (or  all)  of 
its  forma.  The  meaning  zi  'acceptably  well'  may  vary 
with  the  form,  reflectir.g  cha.nges  In  operating  costs, 
constraints  and  capabilities  of  the  system.  There  are 
iwo  types  of  control  actions  available  for  hybrid 
systems:  phase  control  of  x  and  fota  control  of  p. 

In  general,  both  xinds  of  control  will  be  feed¬ 
back  controls  depend) :.g  ipon  possibly  noisy  obser¬ 
vations  of  current  (or  past)  values  of  the  hybrid 
system  state  (x,p).  If  these  quantities  are  not  per¬ 
fectly  observable  then  the  design  of  phase  and  form 
estimators  is  an  integral  part  of  the  overall  control 
problem.  In  this  paper  ve  consider  only  the  phase 
control,  u,  which  is  fzirA  by  minimizing  the  expected 
value  of  a  cost  functlcral 

M-l 

J(u)"E  I  L{K,Xj^,pj^,Uj^)- 

k"0 

H-l 

I  I  J(k>l,x  ,p  ,J,u.  )£li(p  .j,kJ^C(x  ,p  I 

k-0  jat  k  k  k  ,  “ 

over  control  sequences  tu^«u, ,...,0  ,}  where  the 

W  1  )|-1 

I,{K,Xj^,pj^,u^)  are  o;,a rating  costs  that  penalize 

control  energy  expenditure  and  system  perfor¬ 
mance  differently  m  each  form. 

.7(Kal,Xj^^^,pj^,Pj^^,  are  jictp  costs  that  are 

charged  if  a  .  when  the  form  changes.  These 
might  represent  «i*airn-up  or  shut-down  costs  of 
equipment,  or  undesirable  transient  phenomena; 
load  shedding  costa  in  electric  power  systems 
are  examples. 

•  dapendent  upon  the 

final  state  (incliiing  form)  of  the  system. 

In  this  research  ve  propose  extensions  of  the 
well-known  Linesr  Quadratic  (LQ)  problem  to  systems 
having  randomly  juDpir.g  ;araamters,  as  appropriate 
formulations  for  fault- tilcrant  control  problems. 

Our  approach  differs  free  ehe  usual  methods  of  re¬ 
liability  engineering,  in  that  w«  are  seeking  a 
f eedback ,  on-line  methed  to  obtain  system  reliability. 
These  jump  linear  quadratic  (Jt4)  control  problems 
involve  stochastic  hybr.d  systems  modelled  by  linear 
difference  equations  (ih  u  and  x)  and  the  coats  ars 
all  (at  most)  quadratic  in  (x,u). 

These  JLQ  cvjfttrol  problea»  will  be  solved  via 
dynamic  programming.  There  are  two  principle  fac¬ 
tors  that  determine  the  difficulty  of  these  problems: 
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*  fori  D»p<ind€nc»  on  th»  Wm— 

C**mjki  TlM  Cora  is  jandspsiiAsfit  of  thm  i^so 
Csss  a?  Ths  Cora  dspsnds  «Hpon  eurrsnt  <os  post) 
vsiuss  of  ths  piksso  (ist  with  Cssdbock). 

•  AvallabiXity  of  roro  CH^ssnrstions 


Cass  I;  The  Cora  Is  obssrvsd  psrfectly  (without 
Roise) .  Ths  phass  is  sithsr  psrCsctiy 
observed  or  obssrvsd  in  ths  prssimcs  of 
noise. 

Csss  II;  The  Cora  is  not  obssrvsd  psrfscelyji  thus 
it  oust  bs  cstiastod. 

Most  of  ths  results  in  ths  lltsrsturs  hs«s 
cussd  on  Case  lA.  In  this  paper »  %hi  eaaains  a  class 
of  probleos  corresponding  to  case  IB  above,  illus¬ 
trating  the  differences  and  additional  cxMspleJtity  of 
control  probleos  of  this  kind.  The  probleos  cor¬ 
responding  to  Case  II  are  correspondingly  «ore  cost' 
plex,  ami  will  be  the  subject  of  future  research. 

4.  The  Scalar,  Moiseless,  PieeewiseHSonstaat 
Problen 


Consider  the  following  scalar,  noiseless,  two- 
fora,  one-transition  disc  rets- tiSMi  JLQ  phase  control 
prcblMi  with  perfect  c^servations: 

Vi  *  sale's  ‘  ‘■k'V-i. 

'*0'“*  M-l 

where  the  transition  protoabilitias  ara  piecewise- 
constant  in  x  (with  finitely  aany  pieces) r 


(Pj,(l,l) 

e^U.l)j^U,2)/  \  0  I 


for 

Wj^u-i)<  <  Vj^ei) 

where  at  tiM  k,  i*l,2. . . .  and 


o> 


That  is,  at  tijsa  a  the  trens&ticHk  probabilitiee  in 
(I)  have  constant  (in  a)  pieces.  A  wide  veriety 

of  phase  dependencies  can  be  aodelled  by  piecewise- 
<»»nstaat  epproxiauitions  like  (})-(4). 

Once  the  systeei  enters  fora  3,  it  stays  there. 
Thus  the  usual  IQ  solution  yieldst 


''k'S-V 


■II  •  %%<J>  ii.oa.. 


N 


fc 

k*o,l. 


(S) 


,11-1 

(B) 


«diere 

K^(2)-Oj^(2)aaJ(3) 


It  is  clear  that 

''h'n-v*'  *  (SI 

The  following  recursive  elgorithn  oust  be  solved  to 
obtain  (Xj^,Pj^«l)  and  k«JI-l,.  ..,0. 


Propositions 

At  tisM  k,  suppose  that  piecewise- 

quadratic  and  A*  Piecewise -linear  (in  x)  * 

each  with  pieces  (thus 

Pj^*H  -  -k  t^(l,i)  (10) 


far 

where  at  ti»e  k, 

--4 


(Ul 


S-. 


“i-i'Vi'®!.-!* 

piecewise-guadratic  a.-.d  pieeewi se*  1  inear  in  x, 
respectively! 

(U) 


for 

(i-i.a....,«jj.j^). 

The  nkxnber  of  pieces,  obeys 


Proofs  The  nunber  is  cditais  m  Bollowsi  Byrrange 
the  (1^)  ntsdbers  (0) • . . .#tl|^(B^))  in  (11)  And  thm 
(Vj^<l)  nusbers  (Sj^ (Uv^^ (0) , . . . ,a^(l)Uj^C^) }  onlehe 
real  line  (for  Vj^(i)  as  in  (Jl).  m  then  have  en 


ordered  set 

-  •  4  Y^(l)<...<  \(\)  ®  •  (W 

of  (^^1^)  distinct  values.  Thue 

'^k  -  *V  *  ,  (I'f) 

since  -•  and  are  each  praseat  twiee. 

Now  define  the  different  s^  tofiona 

iAj^(i>*  by 

«•) 

hj^(i)  -  (m,^iy(i-n<aj^(l)x^  i  . ♦k 


for  t(ii  as  in  (U) .  Sotei  the  e<pMlitles  In  (Ul 
are  arbitrarily  chosen  to  be  en  the  right-they  could 
be  on  the  left  insteadi  the  srae  is  true  in  (J).  in 
each  regiCNn,  only  one  of  the  different 

probability  valuesX^OI  Is  valid,  tot  1,^(1)  denote 
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fclus  valid  indax.  That  is,. 


for  if 

tn  aach  region,  only  ona  of  tha  diffarant 

cost-to-90  places  is  valid.  Lat  Cj^ii) 

note  tha  index  of  tha  valid  piece.  That  is, 
for  x^€Aj^(i),  if  aj^<l)Xj^  ^ 

then 

Then  the  pieces  of 

*^-l**k-l'^Jc-l“^^  (12)- (13)  are  obtained  by  sol¬ 

ving  following  miniaitation  problem  for  each  x.  . 
value; 


vhere  i  denotes 


v\ 


(i). 


(19) 


This  requires  tha  solving  of  tha  separata  pro- 
blesMf  and  comparing  their  costs  for  each  ^ 

dctervdna  tha  optimal  at  that  value.  Fortunately 
the  problems  each  have  optimal  costs-to-go  that 

are  piecevise-quadratic  in  x  vith,  at  most^  3  pieces 
(each  valid  over  different  ranges  of  values) . 

Thus  In  the  vary  worst  case*  whan  each  of  thasa  threa 
pieces  is  valid  for  soma  there  are  at  most 

Pi»cs»  to  •  Solving  (19)  we  get 


Vx‘Vi-‘l“- 

Vl“’*  Vl'^’Vl  <201 


with  corresponding  control  laws 

)  “  Vi“'Vii  Vi<‘' 

I  *'  Vi“'*  Vi'‘’ViiVi“' 

if  Vi^^^Vi 

(efia  suparseripts  i.  and  II  are  for  left  and  right)# 
where 


^(l.l.C)-(l~Xj^(l)l\d,5)*Xj^U)it^(2) 


(23) 

(24) 


and  for  i»l, 


,“'Vi 


(2S> 


'Vi'-' 


(26) 


X.j(i,i.,C,)\(i)/..,  i:Vx»» 


(38) 


'^E^.x(X,X,,Ci)\(i-X)/C^(l)Vx‘» 


\-x»'‘i'«i>*Vx»-*i-^  A-x'»* 


(29) 

<-x‘»Vx»’ 

tx‘ 


(30) 


\.j(X,t^,C^)S-2Y^(i)S,^.,(X).^.^(X)/b*.^(l.a^(X) 

^^.,(i.»,,Cj)S-2r^(.-i)Vx‘»Vx'“<x‘»‘k'^^ 

.  .A  Y  »)K  <l.t  .C  ) 

^a»- - ^ 

fA  Vx'^’l 

*  -  K  (1.1..C.I*  -5-*^ - 


(31) 


(33) 


aa  y„u-u£  (i9i..^j 

- VX) - 


\ 


U  .  (l,t  . . . ^ 

Vi'^  <x'»*k»^'‘i-V 

-Vi»  \  *i-V 


(34) 

(15) 


l"*i 


*^»-X**’\**'*i'*l” 


(16) 


(37) 


(J8) 


(39) 


The  ninloLi cation  in  (19)  can  be  computed  by  first  de¬ 
termining  each 

using  125)  <>(26}.  Then  the  three  costs  fox  each 

computed  via  (20) 

for  each  i.  Mi  these  quadratic  pieces  are  then 
compared  over  the  where  they  hold,  so  as 

to  determine  the  optimal  cost. 

5.  Discussion  and  f^search  Plans 

Xn  general,  the  algorithm  will  involve  a  large 
number  of  calculations  even  for  relatively  small  M. 
The  comparisons  in  (19)  become  quite  tedious  to  do 
by  hand.  Fortiinately  there  exist  symbolic  mathema¬ 
tical  problesb'solving  computer  programming  languages 
which  can  be  used  to  implement  the  algorithm. 

At  each  time  k,  the  phase  subsystem  state  space  is 
broken  up  into  bl  regions.  In  soma  of  these  regions, 
the  optimal  control  law  does  not  influence  the  tranm- 
ition  probabilities  of  the  next  form  through  control 
of  X;  these  are  the  non-superscripted  control  laws 
in  (21)  (ie;  where  ^ 

other  regions,  the  phase  control  is  used  to  alter 
transition  probabilities;  that  is,  to  actively  hedges 
These  are  the  leftwards  (superscript 
L;  ®*’  rightwards  (superscript  R; 

control  laws  in  (21). 

The  number  of  comparisons  required  in  (19)  de¬ 
pends  upon  how  the  intervals  ^  over¬ 

lap  and  how  they  fill  the  real  line.  At  most,  if 
every  possible  cost  in  (20)  is  optimal  for  some  x^^^^ 

value,  there  will  be  3i)rj^  pieces  in  the  optimal  ex¬ 
pected  costs-to-go  and  control  laws. 

For  soew  problems  it  may  be  possible  to  bound 
the  regions  in  whioh  the  controller  actively  hedges. 
That  is,  there  may  exist  some  b  such  that,  for  |x|>b, 
the  controller  docs  not  actively  hedge.  For  such 
problems  might  solve  the  non-hedging  control  pro¬ 
blems  that  are  valid  outside  of  this  region  and  then 
interpolate  these  costs-to-go  over  the  (bounded) 
hedging  region.  In  this  way  a  computationally  ef¬ 
ficient  approximation  to  the  optimal  hedging  control¬ 
ler  might  be  obtained. 

The  extenaion  of  these  results  to  problmns  with 
driving  noise  is  currently  being  examined.  When  the 
phase  subsystem  is  sub:)ect  to  input  noise,  the  piece- 
wise-quadratic  nature  of  tlwi  optimal  cost-to-go  is 
lost  due  to  the  smoothing  effects  of  the  noise. 
Process  noise  alters  form  transition  probabilities 
because  of  their  phase  dependence.  Driving  itoise 
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also  makes  it  impossible  to  drive  the  phase  with  cer¬ 
tainty  to  the  region  boundaries,  as  in  the  noiseless 
case. 

For  finite  time-horiaon  problmas,  if  we  assume  that 
the  driving  noise  has  bounded  magnitude  then  there  are 
large  portions  of  the  phase  space  (A)  in  which  the 
quadratic  nature  of  the  cost  is  maintained.  These  ere 
regions  where  no  possible  noise  is  big  enough  to  force 
the  phase  into  a  different  x-regron. 

Xf  the  phase  process  is  not  perfectly  observed 
because  of  additive  observation  noise,  the  situation 
is  more  complicated  than  in  the  phase- Independent  case. 
Even  if  the  form  is  perfectly  observed,  uncertainty 
about  X  is  a  source  of  u-ncertainty  about  fora  trans¬ 
itions  that  must  be  reflected  in  t)te  optimal  control 
law.  It  is  not  clear  whether  separation  or  certainty- 
equivalence  results  will  hold  for  such  problems. 

The  scalar  case  addresst*d  above  is,  of  course, 
only  of  academic  interest.  It  is  the  vector  cases 
(where  x€  r”)  that  are  the  important  ones.  In  the 
scalar  case,  the  bou.ndaries  between  x-regions  are 
trivial—  they  are  points.  In  n-dimensional  spaces, 
they  will  be  (n-1) -dimensional  surfaces.  Active  hedg¬ 
ing  appears  to  involve  driving  the  phase  to  'best* 
place  on  the  region  boundary.  This  is  a  simple  fixed 
end-point  optimization  in  the  scalar  case,  in  higher 
dimensions  we  must  optimize  over  a  surface.  A  further 
complication  arise  in  problems  that  include  phase  dis¬ 
continuities  .  These  jumps  in  x  will  complicate  the 
problem  because,  as  with  driving  noise.  It  will  not  be 
possible  to  drive  the  phase  into  x-regions  with  cer¬ 
tainty. 

lit  inclusion,  we  have  presented  a  design  meth¬ 
odology  for  feedback  control  of  a  class  of  simple 
fault-prone  systmns  based  on  optimization  of  suitable 
cost  functionals.  The  solutions  exhibit  hedging 
properties  desirable  in  these  feedback  controllers, 
and  provide  inkight  into  the  structure  of  solutions  to 
more  complex  problems.  iJcTwever,  much  work  ramAins  to 
be  done  in  extending  the  concepts  used  in  this  work 
towards  the  understanding  of  the  feedback  control  of 
general  hybrid  syst^ss. 
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